VOTER INTERFACE FOR ELECTRONIC VOTING SYSTEM 
FOR THE VISUALLY IMPAIRED 
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Field of Invention 

The present invention relates in general to a programmable, electronic voting 
system and a user interface for such a voting system, and a voter check-in system. 

Background of the Invention 

One of the most important foundations of a democracy is the right to vote. To 
ensure that each voter can effectively exercise that right and to ensure confidence in 
the results of any election, integrity of the process for casting and counting votes is 
paramount. The essential challenge is to achieve accurate identification of voter 
preferences while preserving voter anonymity. 

Prior voting systems such as written paper ballots, punched cards, and 
mechanical switch panels have been overly complex and subject to numerous 
problems in connection with accurate recording and counting of votes. Due to the 
need to collect votes fi"om a large number of voters in a short time, election officials 
have tried various techniques to reduce the time it takes for a voter to cast their ballot. 
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Unfortunately, these have tended to create more voter confusion or have failed 
because of the deficiencies underlying the basic technologies used. The inaccuracies 
of vote counts and/or loss of votes that regularly occur have continued to raise much 
concern. 

5 Electronic or computerized voting for governmental elections is now being 

investigated as an altemative for addressing some of the deficiencies of the prior art. 
However, a satisfactory system has remained elusive because of the many competing 
requirements for an acceptable voting system. For example, voter errors should be 
minimized or eliminated, but it is also desired that the amount of time required to 
10 complete a ballot should be a short as possible. Preferably, the vote must be 
maintained in a manner that allows a vote recount to take place. Public confidence in 
the integrity of electronic data storage, as well as the user friendliness of electronic or 
computer equipment and the "computer-phobia" felt by certain potential voters, must 
be taken into account. Furthermore, the readability (e.g., size) of text and/or non- 
15 native language abilities can create further confusion and errors. The foregoing 
problems have discouraged the adoption of electronic, computerized voting systems. 

Further, conventional voting systems typically require visual recognition of 
the voter selections to be made, and fail to fully accommodate the needs of 
individuals who are visually impaired in that they may be blind or may have low 
20 vision, or who cannot read. These individuals may be discouraged fi-om voting due to 
lack of independence or due to lack of certainty in successful completion of the voting 
process. 

25 
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Summary of the Invention 

The present invention provides a robust interface for an electronic voting 
system which reduces errors, builds voter confidence in electronic voting, and reduces 
the time it takes to complete a ballot, to tabulate vote counts, and to report them from 
5 local polling places to centralized authorities. 

In one aspect of the invention, a method is provided for operating a voting 
station in an electronic voting system programmed for predetermined election contests 
taking place on a predetermined election day. The voting station includes a display 
screen for displaying textual and pictorial information and a user selection device for 

10 selecting items from said textual and pictorial information to indicate preferences of a 
voter. In one preferred embodiment, the display screen and user selection device is 
integrated as a touch-screen display. An identified voter is first authorized to cast an 
anonymous ballot using the voting station. The display screen presents a slate of 
candidates for an elected office, each of the candidates being displayed as a selection 

15 item including a textual name identifier and a photo. The voter manipulates the user 
selection device to select a desired one of the candidates. Then the display screen 
presents an enlarged representation of information corresponding to the desired 
candidate together with a confirmation selection item and a cancel selection item. The 
voter manipulates the user selection device to select either the confimiation selection 

20 item or the cancel selection item. If the cancel selection item is selected, then the 
display screen retums to presentation of the slate of candidates. If the confirmation 
selection item is selected, then the display screen progresses through remaining 
election contests until the voter has confirmed a selection in each election contest. The 
display screen presents all voter selections on a review screen and presents choices to 



the voter to change any of the selections. After the voter confirms no further changes, 
the voting station outputs the voter selections. 

The voting system logic can also be applied to other processes such as 
surveying consumer acceptance of products. 

According to other embodiments, the voting system may be utilized in an 
audio mode where selections are made in response to audio prompts. The audio mode 
is provided to assist a voter with impaired vision. According to one embodiment, the 
audio mode information may be provided to at least one additional person, such as a 
polling place worker, engaged to assist the voter. 

According to one embodiment, the audio mode is provided with corresponding 
text and pictorial displays on the display monitor, each display corresponds to an 
audio prompt or to a voter selection made in response to an audio prompt. The audio 
mode with corresponding text and pictorial display is also provided to assist a voter 
with impaired vision or to provide information to at least one additional person, such 
as a polling place worker, engaged to assist the voter. 

Brief Description of the Drawings 
Figure 1 is a hardware diagram showing an architecture of an electronic voting 

system. 

Figures 2 through 4 are flowcharts showing a preferred method of the present 
invention. 

Figures 5 through 18 show the appearance of a touch-screen display during 
operation of a preferred embodiment of the present invention. 

Figure 19 shows an example of a hardcopy ballot generated by the present 
invention. 



Detailed Description of the Preferred Embodiment 

Referring to Figure 1, an electronic voting system includes a voting station 10 
coupled within a computer network to a local server 1 1 (e.g., located within a voting 
precinct or polling place and connected to other voting stations within the precinct). 
5 Voting station 10 is set-up to provide privacy during voting and includes a display 
monitor with integrated touch screen 12 connected to a workstation or personal 
computer 13 which is programmed to communicate with server 11 and to provide a 
voter interface for predetermined election contests taking place on a predetermined 
election day. Integrated display monitor/touch screen 12 displays textual and pictorial 

10 information and is responsive to voter manipulation for selecting items from the 
textual and pictorial information to indicate the voter's preferences. As an alternative 
to the touch screen selection device, a mouse 14 can be provided to make selections 
using the same graphical user interface on display monitor 12. A keyboard 12a with a 
Braille keyboard is attached to the computer for the visually handicapped. 

15 For purposes of providing individual printed ballots reflective of the votes cast 

by each voter, a printer 15 is connected to computer 13 on which a ballot 16 is being 
printed. Headphones 17 are coupled to computer 13 which together provide an audio 
system that can be used to provide audible help to a voter (e.g., spoken instructions 
for those with limited reading literacy in the available languages or for those with 

20 eyesight limitations). For example, computer 13 includes a sound card and sound files 
have pre-recorded instructions in each of the predetermined languages. 

Printed ballots may be collected and stored for use in vote recounts. 
Altematively, the printed ballots could be collected and scanned using separate 
scanning equipment (not shown) for determining an official vote count for the 



respective precinct (e.g., if it is desired to electronically isolate the vote counting 
equipment). Preferably, the actual real-time vote tally is tabulated electronically via 
transmission over the computer network connection to precinct server 1 1 . Server 1 1 is 
connected via a secure network 20 (e.g., a virtual private network or VPN over the 
5 Intemet) to a city server in a city election office. The city server is also connected to 
other precinct servers (not shown). Server 21 is connected via a secure network 22 to 
a server 23 at the county level which collects vote data from the city servers within 
the county. 

Likewise, a secure network 24 connects a server 25 in a state election office to 

10 all of the county servers. State server 25 is coupled to a master databank 26 for 
maintaining an official vote tabulation (e.g., for the state and federal election 
contests). A mainfi-ame computer (not shown) may be provided for controlling 
database 26. Central vote accumulation may be performed at different levels 
depending upon the specific elective offices or the entities through which specific 

1 5 proposals are being made. 

An operating method and an overall voter interface for the electronic voting 
system is shown in the flowcharts of Figures 2-4 which will be described in 
conjunction with the display contents (i.e., screen shots) in Figures 5-18. 

Prior to use by a voter, a voting station is preprogrammed for the 

20 predetermined election contests (e.g., elected offices and ballot proposals) for an 
election being held on a predetermined election day. The voting station is initialized 
in a wait mode in step 30. A voter's identity and eligibility to vote are determined in 
step 31 and if eligible, then their use of the voting station is authorized. Identification 
and eligibility may be determined in any suitable manner, such as by presentation and 

25 manual acceptance of a signed voter's card or by electronic identification using 



fingerprints or other identifying characteristics. Identification and authorization may 
be conducted by the voting station itself. During the time that the voting station is in 
the wait mode, the display screen may show a message saying ''Waiting for Next 
Voter. If You Need Help, Please Ask an Election Worker'', In step 32, an authorized 
5 voter approaches a voting station and initiates the process of voting. 

In step 33, a voter selects the language that they prefer to use in the voting 
process. As shown in Figure 5, a language selection screen (presented in a default 
language, such as EngUsh) includes selection items 100 (i.e., menu buttons) 
corresponding to the preprogrammed languages available. The voter may touch a 

10 desired button so that all subsequent screen text or other written instructions are 
provided in the desired language. In one preferred embodiment, the screen in Figure 5 
also alerts a voter to the fact that any text shown on a display screen (other than a 
selection item) can be enlarged (e.g., doubled in size) for making it easier to read by 
simply selecting (e.g., touching) the text. 

15 After a language is selected, the voter is prompted to indicate whether they 

desire audible (i.e., audio) help in step 34. The corresponding display screen is shown 
in Figure 7. If audible help is desired, then the audible help function is tumed on in 
step 35 while instructions for using the audio system (e.g., to put on the headphones) 
are displayed. If audio is tumed on, then all subsequent display text or a 

20 predetermined portion thereof are audibly reproduced. 

Once a language and the use of audible help are established, the instructions, 
any other text displays, and any audible help are provided in the selected language. 
Voting rules and instructions are presented to the voter in step 36. For example, 
Figure 7 shows a screen explaining that to cast a vote for a candidate, the candidate's 
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picture should be touched on the touch screen. After reading this explanation, the 
voter touches a target area to proceed to vote. 

In step 37, the voter is prompted to select a voting mode from the choices of 
straight party ticket, split ticket, or mixed ticket. The corresponding screen is shown 
5 in Figure 8. As explained on the screen, the straight party ticket mode allows the voter 
to choose a party. All votes are cast in the partisan portion of the election for 
candidates of the chosen party. Then the voter is taken to any nonpartisan or proposal 
sections of the election contests. In the split ticket mode, the votes for the partisan 
contests are initialized for candidates of the selected party but each contest is 

10 presented to the voter so that any individual votes can be changed. In mixed ticket 
mode, each contest is presented without any initialization of the votes. 

The voter selects "straight ticket" selection item 101, "split ticket" selection 
item 102j or "mixed ticket" selection item 103 on the screen of Figure 8. In the 
operating method of Figure 2, a check is made in step 38 to determine if the voter has 

15 selected either a straight ticket or a split ticket. If so, then the available political 
parties are displayed in step 40 and the voter touches the name of the desired party 
(the corresponding screen is shown in Figure 9). A check is made in step 41 to 
determine if the straight ticket mode is selected. If it is, then votes are entered for the 
candidates of the selected party in step 42 and the method proceeds to any nonpartisan 

20 election contests at point B (which links to Figure 4). If step 38 detects mixed ticket 
mode or if step 41 detects split ticket mode, then the method proceeds to the partisan 
election contests at point A (which links to Figure 3). Additional instructions for the 
split ticket and mixed ticket modes may be shown, such as a mixed ticket message 
shown in Figure 10. 
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Proceeding from point A in Figure 3, a first partisan contest is fetched in step 
43. A check is made in step 44 for the split ticket mode. If not in split ticket mode 
(i.e., mixed ticket mode is active), then a slate of candidates for the current election 
contest is displayed in step 45. Each candidate is identified by at least a textual name 
5 identifier and preferably by a name, picture, and political party as shown in the screen 
view of Figure 1 1 , In step 46, the voter selects a candidate by touching the selection 
item block (containing the candidate's name, picture, and party) of their choice. 
Additional selection items may be provided for writing-in the name of a candidate (if 
appropriate) or for skipping the current election contest without entering a vote. If 

10 step 44 determines that voting is in split ticket mode (i.e., a preferred political party 
has been chosen), then the vote for the current contest is initialized to the candidate(s) 
of the chosen party and the method proceeds directly from step 44 to step 47. 

In step 47, an enlarged display (e.g., between one-quarter screen and full 
screen as shown in Figure 12) of the selected candidate is presented to the voter along 

15 with a confirmation selection item (e.g., the "yes" button in Figure 12) and a cancel 
selection item (e.g., the "no" button in Figure 12). Step 48 waits for the voter to select 
one of the buttons, and if the candidate selection is cancelled then a return is made to 
step 45 to re-display the slate of candidates. If the candidate selection is confirmed, 
then a check is made in step 50 to determine whether more candidates from the slate 

20 can be selected (i.e., the election contest is for multiple seats). If more candidates can 
be selected, then a return is made to step 45 wherein the slate of candidates is 
redisplayed with an indication of the candidate(s) already selected (e.g., highlighting 
or shading of a deactivated selection item block for the already chosen candidate). 

If no more candidates can be selected (or if the voter skips any fixrther 

25 selections), then a check is made in step 51 to determine whether there are additional 



partisan election contests to be voted. If so, then a return is made to step 43 to fetch 
the next contest. Figure 14 demonstrates a slate for further partisan contests for which 
votes can be cast for only one candidate. Figure 15 shows an enlarged display for 
confirming a vote for one of the candidates on this slate. 
5 If there are no further partisan contests, then a summary screen may be 

presented to the voter in step 52 to allow review and/or changes to the votes cast. 
Alternatively, the method may proceed directly to any nonpartisan contests at point B 
and any review or changes can be done once after all votes have been cast on the 
entire ballot. 

10 Voting for nonpartisan contests begins at point B in Figure 4. The first 

nonpartisan contest is fetched in step 53. A slate of candidates for the nonpartisan 
contest is displayed in step 54. In step 55, the voter selects a candidate by touching the 
selection item block containing the candidate's name, picture, and party of their 
choice. In step 56, an enlarged display of the selected candidate is presented to the 

15 voter along with a "yes" button and a "no" button. If the selection is not confirmed in 
step 57, then a retum is made to step 54 to re-display the slate of candidates. If the 
candidate selection is confirmed, then a check is made in step 58 to determine 
whether more candidates fi-om the slate can be selected. If more candidates can be 
selected, then a retum is made to step 54 wherein the slate of candidates is re- 

20 displayed with an indication of the candidate(s) already selected. 

After no more candidates can be selected (or if the voter skips any further 
selections), then a check is made in step 60 to determine whether there are additional 
nonpartisan election contests to be voted. If so, then a retum is made to step 53 to 
fetch the next contest. Otherwise, a summary/change screen may be presented to the 

25 voter in step 61. 
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Thereafter, the method proceeds to voting on any proposals (i.e., ballot 
initiatives) included in the election contests that are decided by yes or no votes. In 
step 62, a first proposal is fetched. In step 63, the approved text of the proposal is 
displayed on the touch screen monitor. An optional font size can be selected so that 
5 the text can be enlarged to any extent necessary to allow it to be read by voters with 
poor visual acuity. The voter selects a yes vote, a no vote, or skips voting on the 
proposal in step 64. An enlarged display of the desired selection is shown in step 65 
along with confirmation and cancel buttons. If not confirmed, then the text of the 
proposal is re-displayed in step 63. Otherwise, a check is made in step 67 to determine 

10 whether there are additional proposals to be voted on. If there are more, then a return 
is made to step 62 to fetch the next proposal. If there are no more proposals, then 
voting selections are finished. Figure 17 shows a screen that is displayed to inform the 
voter that their ballot is completed and that their selections can be reviewed prior to 
printing and submitting their votes. 

15 Unless the voter chooses not to review any selections, a sununary and change 

screen is presented in step 68. Figure 18 shows a summary pop-up window overlying 
the screen of Figure 17. The summary window shows each election contest and any 
selections that have been made by the voter. If the voter has selected the wrong 
candidate, in error, he touches the NO name to go to the beginning of the process, 

20 then touches SKIP until he reaches the vote he wants to change. When a new selection 

is made and confirmed, the method retums to the summary window of Figure 18. 

After the voter has completed any review, they touch a selection item to 

indicate that they are finished and that they wish to print their ballot. A hardcopy of 

the ballot is printed in step 70. In an embodiment wherein the votes cast are tabulated 

25 electronically directly from the voting stations, the votes cast are transmitted to a 
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server databank in step 71 concurrently with printing the hardcopy. The hardcopy 
ballot is submitted to a ballot box in step 72 (e.g., for purposes of a recount or as an 
original ballot for an official vote count if desired). Preferably, the hardcopy ballot 
may be retrieved by the voter from the printer and delivered personally to a ballot 
5 box, thereby increasing the confidence level of many voters in the integrity of the 
voting system since they experience something physically tangible showing their 
votes. Once the voter leaves the voting station, the display reverts to the wait screen 
of Figure 5. 

To improve counting and handling of hardcopy ballots, each election contest 

10 and selected candidate or other result of a vote may preferably be printed on the 

hardcopy ballots by means of a barcode or other electronically scannable symbols. A 

sample hardcopy ballot is shown in Figure 19. 

In a stiff further embodiment, an electronic voting system, as disclosed in U.S. 

Patent Application Serial Number 10/120,221, further includes a text size selection 

15 feature, as illustrated in Figure 20. The text size selection feature enables the user to 

adjust the size of the text to suit his or her comfort. The text selection feature includes 

sample text, an increase size indicator, a decrease size indicator, and a slide bar. The 

sample text appears in a predetermined font size, as shown by way of example in 

Figure 20. Actuation may be accomplished by known means, for example, by mouse, 

20 touch screen, or stylus. To decrease the size of the sample text, the user actuates the 

decrease size indicator. The decrease size indicator appears in Figure 20 by way of 

example as the symbol For each user actuation of the decrease size indicator, the 

font size of the sample text will correspondingly decrease. Similarly, to increase the 

font size of the sample text, the user actuates the increase size indicator. The increase 

25 size indicator appears in Figure 20 by way of example as the symbol For each 
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user actuation of the increase size indicator, the font size of the sample text will 
correspondingly increase. Alternatively, to adjust the size of the sample text, the user 
can manipulate the slide bar, depicted by way of example as a white rectangle in 
Figure 20. Moving the slide bar in a first direction will decrease the font size of the 
5 sample text, while moving the slide bar in a second direction will increase the font 
size of the sample text. Once the user indicates that he or she is satisfied with the 
selected font size of the sample text, the same or substantially similar font size will be 
used in the remainder of the voting process. 

In a yet still further embodiment, an electronic voting system, as disclosed in 

10 U.S. Patent AppHcation Serial Number 10/120,221, further includes a flashing 
selection indicator feature, as illustrated in Figure 21. A selection bar is included on a 
portion of most screens viewed by the voter in the voting process. The exemplary 
selection bar illustrated in Figure 21 includes several user selections, including, but 
not limited to, "BACK," "WRITE IN," "SKIP VOTE," and "NEXT." The user 

15 selections within the selection bar that are valid actions for a given screen in the 
voting process will change in appearance so as to draw attention thereto, for example 
by flash. In the altemative, only a predetermined default selection within the selection 
bar, such as but not limited to "NEXT" will flash, indicating to the user that actuating 
the flashing selection will cause the next screen in the voting process to be displayed. 

20 According to other embodiments, the voting system of Fig. 1 may be utilized 

in an audio mode that provides the voter with audio prompts and receives voter 

selections made in response to those audio prompts. The voter selection is made by a 

non-visual means that does not require sight. According to one embodiment, the 

system is adapted to receive voter responses to audio prompts from a non-visual 

25 means of voter input such as by a mouse 12a. According to one embodiment, at least 

13 



one set of headphones 17 or other private listening means is provided at each voting 
station and the voter receives audio prompts through the private listening means. 

The audio mode embodiments provided herein are suitable for use by a 
visually impaired voter such as a voter who is blind or who has low vision. In 
5 addition, the audio mode would be suitable for use by a voter who cannot read or has 
difficulty reading. According to one embodiment, the audio mode information may 
be provided to at least one additional person, such as a polling place worker, engaged 
to assist the voter. 

According to one embodiment, the voting system of Fig. 1 may be utilized in 
10 an audio mode that provides the voter with audio prompts and additionally provides 
text and pictorial displays on the display monitor 12, each display on the display 
monitor 12 corresponds to an audio prompt or to a voter selection made in response to 
an audio prompt. According to one embodiment, the system is adapted to receive 
voter responses to audio prompts from a non- visual means of voter input such as by a 
15 mouse 12a. The audio prompt instructs the voter to input the response via right or left 
mouse 12a cUck in accordance with the corresponding result desired by the voter. 
This provides for a low cost system in that special hardware is not required to enable 
the voter to enter a response to an audio prompt. According to one embodiment, at 
least one set of headphones 17 or other private listening means is provided at each 
20 voting station and the voter receives audio prompts through the private listening 
means. According to one embodiment, a keyboard may additionally be attached to 
the voting system, and is activated for use only when an a "write-in" response is 
desired. Only the necessary keys are activated to improve accuracy of the response. 
According to one embodiment, the keyboard includes Braille characters. 
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If the display monitor 12 is also a touch screen, the touch screen is placed in 

an inoperable mode so that it serves only as a display monitor for text and pictures 

corresponding to the audio prompts and the responses to the audio prompts. The 

corresponding visual display may additionally be adjustable by the voter by a non- 

5 visual means while the system is in audio mode. 

The audio mode v/ith corresponding text and pictorial display is suitable for 

use by a visually impaired voter such as a voter who is blind or who has low vision. 

In addition, the audio mode would be suitable for use by a voter who cannot read or 

has difficulty reading. According to one embodiment, the audio mode with text and 

10 pictorial display may provide information to at least one additional person, such as a 

polling place worker, engaged to assist the voter. 

The audio mode may be provided in any one language of a variety of 

languages. According to one embodiment, the voter selects audio mode or someone 

assists the voter in selecting audio mode. The voter then receives an audio prompt to 

15 choose a language. All information transmitted to the voter from the voter interface is 

provided to the voter selected language. According to one embodiment, an audio 

prompt asks the voter whether he or she would like audible instructions or overview 

of an audible demonstration before voting begins. According to one embodiment, the 

audio portion and text portion of the voter interface having the corresponding pictorial 

20 and text display are provided in a voter selected language in response to an audio 

prompt to select a language. 

According to one embodiment, the voting system prompts the voter to make 

only one of two choices at each step in the voting process, such as a choice to proceed 

or not to proceed, a choice between choosing an option or receiving additional 

25 options, a choice to confirm choices or not confirm choices, or a choice to provide a 
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"write-in" response or not. This simplifies each step of the voting process to a simple 
easy to answer question. 

As will be understood by one of ordinary skill in the art, each voting system 
will be customized to a given election. 
5 Exemplary embodiments are provided herein in Fig. 22 - Fig. 26 for a set of 

programmed audio instructions guiding a voter through the voting process. 

Fig. 22 illustrates an embodiment of a flow chart for the voting system of the 
present invention in audio mode. According to one embodiment, the audio mode 
provides the voter with an audio list of options regarding the possible formats for the 

10 election. According to one embodiment, the possible format options include, but are 
not limited to: "straight ticket", "split ticket", and "mixed ticket". This notifies the 
voter of the upcoming format choices and prompts the voter to indicate when he or 
she is ready to continue. The system checks for the voter's response and if the voter 
has indicated that he or she is ready to continue, the system proceeds with a series of 

15 audio prompts, each related to a particular format option that was previously listed. 
The system checks for the voters response to each format option, and if the voter does 
not select any format, the voter again receives a series of audio prompts each related 
to one of the possible format options. Once the voter has chosen a format, the system 
proceeds to a corresponding next step. 

20 Fig. 23 illustrates an embodiment of a flow chart for the voting system of the 

present invention in audio mode. According to one embodiment, the audio mode 

provides the voter with an audio list of options regarding the political parties 

participating in the election. This notifies the voter of the upcoming party choices and 

prompts the voter to indicate when he or she is ready to continue. The system checks 

25 for the voter's response and if the voter has indicated that he or she is ready to 
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continue, the system proceeds with a series of audio prompts, each related to a 
particular political party that was previously listed. The system checks for the voter's 
response to each party option, and if the voter does not select any party, the voter 
again receives a series of audio prompts each related to one of the possible party 
5 options or prompts the voter to change the format selection. Once the voter has 
chosen a party or has chosen mixed format, the system proceeds to the next step. 

Fig. 24 illustrates an embodiment of a flow chart for the voting system of the 
present invention in audio mode. According to one embodiment, the system 
recognizes whether the voter has chosen a party in the straight ticket or split ticket 

10 format or whether the voter has chosen the mixed ticket option in previous steps. 

If the voter selected a party, the system notifies the voter of each individual 
contest, the voter's selection of party and candidate for that contest, and provides a 
prompt allowing the voter to alter the selection for the individual contest. If the voter 
wishes to alter the selection, the system provides a series of audio prompts each 

15 related to one of the possible candidates and the candidate's corresponding political 
party or the option to confirm or cancel the selection. The system also provides 
additional audio prompts relating to the additional number of candidates that may be 
chosen for a particular contest, the remaining available candidates and corresponding 
parties, and any further non-partisan contests. If the voter has mad no selections, the 

20 system prompts the voter to proceed with candidate selection or decline to vote. If the 

voter indicates no additional changes and if there are no proposals to be voted on, the 

system proceeds to audio review of the voter's selections. If there are proposals to be 

voted on, the system proceeds to audio prompts related to the proposals. 

If the voter previously chose the mixed ticket format, the system provides the 

25 voter with audio information regarding each separate contest, candidate and 
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corresponding party and allows the voter to select at least one or skip that contest, the 
system provides a series of audio prompts each related to one of the possible 
candidates and the candidate's corresponding political party or the option to confirm 
or cancel the selection. The system also provides additional audio prompts relating to 
5 the additional number of candidates that may be chosen for a particular contest, the 
remaining available candidates and corresponding parties, and any further non- 
partisan contests. If the voter has mad no selections, the system prompts the voter to 
proceed with candidate selection or decline to vote. If the voter indicates no more 
changes and if there are no proposals to be voted on, the system proceeds to audio 

10 review of the voter's selections. If there are proposals to be voted on, the system 
proceeds to audio prompts related to the proposals. 

Fig. 25 illustrates an embodiment of a flow chart for the voting system of the 
present invention in audio mode. According to one embodiment, the system provides 
the voter with audio prompts related to proposals to be voted on. The system provides 

15 an audio prompt for the short or long version of a proposal, an audio prompt to skip 
to the end of at least some proposals, and an audio prompt to vote or skip the 
proposal. If voting on a proposal, the voter is prompted for a yes or no response and 
is prompted to confirm or cancel the selection. If canceled, the process repeats. Once 
the system receives the voter's confirmation, the system provides an audio prompt for 

20 the next proposal until all voter responses complete. If no more proposals remain to 

be voted on, the voter then receives an audio prompt for audio vote review. 

The flow chart in Fig. 26 illustrates an embodiment of the audio mode of the 

inventive voting system. According to one embodiment, the system prompts the voter 

to either confirm all selections made or to review the selections. If after review the 

25 voter wishes to make changes, the individual selections are reviewed and the voter is 
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prompted to confirm that changes are desired. If the voter confirms that changes are 
desired, the system returns to the audio prompts related to the contest or proposal the 
voter would like to change. 

According to one embodiment, the visual mode and the audio mode with 
5 corresponding pictorial and textual display, of the present invention can be unified to 
utilize the same set and sequence of screen displays. 

The present invention includes computer readable storage media encoded with 
software for carrying out the voter interface embodiments and voting system 
operations described herein. 
10 According to one embodiment, a user selection means is provided to receive 

user input. According to various embodiments the user selection means may be a 
keyboard, a mouse or a Braille keyboard. According to one embodiment, all input 
features are activated for the user selection means. 

According to one embodiment, a plurality of audio prompts are provided in 

15 which each audio prompt asks the voter to choose between two possible options at 

each step in a voting process. A user selection means is provided to receive the 

voter's response to the prompt asking the voter to choose only one of two possible 

responses. According to one embodiment, the user selection means recognizes only 

two input options, the voter provides his or her response by executing one of the two 

20 input options. Thus, the input option selected by the voter corresponds to the voter's 

choice of one of two possible responses. For example, the user selection means may 

be a device having only two buttons, one button represents one of the two possible 

choices and the other button represents the other of the two possible options. The user 

executes his or her response through contact with the button corresponding to the 

25 voter's preference. The user selection means may be a device having only two 
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activated buttons. One button represents one of the two possible choices and the other 
button represents the other of the two possible options. The user executes his or her 
response through contact with the button corresponding to the voter's preference. The 
user selection device may have a single button for which contacting the button once 
5 indicates one of two possible responses and contacting the button twice indicates the 
other of the two possible responses. The user selection device may be a sound 
recognition system recognizing two possible verbal responses by the voter. The voter 
executes their selection by verbally stating the response corresponding to their 
preference. The user selection device may be a breath activated device that recognizes 

10 the input of one breath or two breathes. The voter executes his or her response by 
exhaling a single breath or exhaling two breaths. Once the voter selection is made in 
response to the prompt to select one of two choices, another prompt may follow 
allowing the voter to select between another set of two choices. The voter may 
respond in a like manner using the user selection means. This approach of prompting 

15 the voter to choose between two possible responses reduces voter error during the 
voting process. The provision of a user selection means recognizing two possible 
inputs assists in reducing voter error during the voting process. 

According to one embodiment, a voter check-in system confirms voter 
eligibility to vote and generates a card that activates the polling station where the 

20 voter votes and displays a ballot specific to a particular voter. As part of the process 

of confirming voter eligibility, the voter check-in system uploads a qualified voter list 

stored on a polling place server via a secure local area network (LAN). When a 

potential voter arrives at the polling place, a poll worker identifies the voter. 

According to one aspect of the invention, the voter is identified by swiping an 

25 existing state identification card, or by swiping a state driver's license at voter check- 
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in. According to one embodiment, the voter is identified through presentation of a 
voter registration card having the voters identification number that was assigned when 
the voter registered to vote, the voter identification number specific to that voter is 
input into the check-in system. According to one embodiment, voter specific criterion 
other than the voter registration number is input and a search matching the input 
information to the quahfied voter Hst stored on the polling place server displays at 
least one possible match. If no match can be identified, the system accepts input 
corresponding to a provisional voter. 

Once a voter match is selected or provisional voter input is completed, a 
transportable medium is generated. The transportable medium is then used at the 
polling station where the voter votes to retrieve the ballot appropriate for the 
particular voter. According to one embodiment, the transportable medium is a card. 
The card is then used at the polling station where the voter votes, to retrieve the ballot 
appropriate for that voter. 

According to one embodiment, when a voter match is selected, the voter may 
input information to finally verify the selection. According to one option, a digital 
signature option may be presented to the voter for verifying the proper choice of voter 
information. The voter may provide a signature that is stored digitally. 

According to one embodiment, a biometric measurement of the voter may be 
made and recorded. The measurement may be used to search for the voter in a voter 
eligible list or database in order to identify the voter. Such a measurement may also 
be recorded as an indication by the voter verifying the proper selection of voter 
information. 
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Figure 27 illustrates an embodiment of a screen in a voter check-in system. 
Selection of the next voter check-in button results in the display of a search screen 
that can be used in searching for a voter. 

Figure 28 is an illustration of a Find Voter Screen. According to one 
embodiment, a search screen may be presented that can be used in searching for a 
voter. Data provided by the voter is entered into the screen. Such data may be the 
voter's identification number which is assigned by a government body when the voter 
registers to vote, the voter's state identification number, the voter's driver's license 
number, the voter's name, or the voter's social security number. Other voter specific 
information may be used which will correspond to stored qualified voter information. 
A system conducts a search. If the criterion entered matches an entry in the qualified 
voter list that match will be displayed. Once the proper voter information is 
displayed, a selection may be made, if appropriate, to indicate that the voter is 
visually impaired. According to one embodiment, the search screen may take the 
form of the screen in Figure 28. 

Figure 29 is an illustration of a Check-In Search Summary Screen. According 
to one embodiment, a search summary screen may be presented in which the search 
result matching information in the stored qualified voter list is displayed. Additional 
voter information may be displayed to assist in verifying the match. If the match is 
initially verified, the voter may be selected. Once the proper voter information is 
displayed, a selection may be made, if appropriate, to indicate that the voter is 
visually impaired. According to one embodiment the search summary screen takes 
the form of the screen in Figure 29. The check-in button may be selected to select the 
highlighted voter. 
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Figure 32 illustrates an embodiment of a No Voters Found Screen. According 
to one embodiment a screen may be presented to indicate that no voters were found to 
match the criteria or criterion in put. If no voters were found in the qualified voter list 
to match the criterion provided, a database search may be performed. According to 
5 one embodiment, the screen indicating that no voters were found may take the form of 
the No Voter's Found Screen of Figure 32. The screen may prompt the user to 
indicate whether a database search is desired. The screen may provide for a yes or no 
response. If the selection is yes, then a data base search is conducted based upon the 
input criterion. 

10 Figure 33 illustrates the Check-In Summary Displaying the Closest Match to 

the Criteria Entered Screen. According to one embodiment, a screen may be 
presented to display the closest matches to the input criterion, each possible match 
may be highlighted and additional voter information may be displayed to assist in 
verifying the proper match. According to one embodiment, the screen presenting the 

15 closest matches may take the form of Figure 33. The proper match may be 
highlighted. Once the proper voter information is displayed, a selection may be made 
according to one embodiment to indicate that the voter is visually impaired. Once the 
proper selections are made for a voter, the check-in button may be selected. 

Figure 34 illustrates a No Voters Found, Create Provisional Voter Screen. 

20 According to one embodiment, if no matches correspond to the criterion entered, a 
screen may be presented to indicate that no voters were found to match the input 
criterion. According to one embodiment, if not matches correspond to the criterion 
entered and the database search, a screen may be presented to indicate that no voters 
were found to match in the database search. According to one embodiment, the 
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screen may take the form of the No Voters Found, Create Provisional Voter Screen of 
Figure 34. The screen provides for a yes or no response. 

Figure 35 illustrates an embodiment of a Create Provisional Voter Screen. 
According to one embodiment, a screen may be display for entry of data to define a 
5 provisional voter. The screen may allow for entry of information including but not 
limited to: voter identification number, drivers license number, social security 
number, voter name, voter address information. According to one embodiment, the 
screen for entry of data to define a provisional voter may take the form of the screen 
in Figure 35. 

10 Figure 29 illustrates an embodiment in which a ballot is automatically 

associated with the highlighted voter. 

Figures 30 and 33 illustrate an embodiment in which a list of ballots are 
displayed. A selection of the appropriate ballot or ballots may be made. 

Figure 35 illustrates an embodiment in which one or more precincts are 

15 represented at a polling place. According to one embodiment a voter check- in screen 
listing voter information allows selection of the proper ballot for the voter. For a 
provisional voter, this field may remain blank until Country, Jurisdiction and Precinct 
have been specified, after which the screen is populated with the appropriate ballot or 
ballots. 

20 Figure 31 illustrates an embodiment of presentation of a digital signature 

option. A voter may provide a signature that is stored digitally to verify a selection. 

According to one embodiment, a digital signature option is provided in response to 

highlighting of the proper voter information and selection of the check-in button as 

described with respect to Figure 29. According to one embodiment, a digital 

25 signature option is provided in response to highlighting of the proper voter 
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information and selection of the check-in button as described with respect to Figure 
30. According to one embodiment, a digital signature option is provided in response 
to highlighting of the proper voter information and selection of the check-in button as 
described with respect to Figure 33. According to one embodiment, a digital signature 
5 option is provided in response to selection of the check-in button as described with 
respect to Figure 35 after the provisional voter information is sufficiently populated 
and a ballot option has been made available and has been selected. 

According to one embodiment, a biometric measurement such as a fingerprint 
may be used to verify the voter. The fingerprint information may be used at check-in 

10 to match the voter fingerprint to voter information in a searchable database. One 
advantage of such a procedure is that it can be used to verify the voter where 
traditional voter information such as voter state identification number, driver's 
license, voter registration identification number, name or address are not available or 
are not necessarily determinative of a voter's identity. The fingerprint information 

15 may be stored digitally. According to one embodiment, the voter may sign 
electronically after the voter's fingerprint information is used to retrieve voter specific 
information to verify that the information retrieved is accurate. 

According to one embodiment, a voter may provide a fingerprint to verify the 
proper identification of the voter at voter check-in. The fingerprint information may 

20 be stored digitally. According to one embodiment, the fingerprint information 

obtained fi-om a voter at voter check-in may be used to verify the proper selection of 

retrieved voter information and selections with respect to whether the voter is visually 

impaired and the proper ballot selection for the voter. 

A ballot may be matched to a voter based upon voter specific information. 

25 According to one embodiment, a ballot is matched to a voter based upon County, 
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Jurisdiction and Precinct information corresponding to that voter. There may be 
proposals to be voted on by certain voters, for instance a proposal may apply only to 
voters of a particular street. The voter specific ballot will contain the candidate 
options and proposal options available to that particular voter. 
5 A transportable medium may be generated at voter check-in that contains 

information that may be used at the polling station where the voter votes to provide 
the voter with the screen ballot corresponding to that voter. According to various 
embodiments, the transportable medium may contain voter specific information, 
ballot specific information or a unique number or digital information generated for 

10 use in retrieving the ballot for the particular voter. According to one embodiment, the 
transportable medium may be a card generated with voter specific information stored 
thereon. The voter specific information may include party affiliation. According to 
one embodiment, the transportable medium may be a card generated with ballot 
specific information corresponding to the particular voter stored thereon. According 

15 to one embodiment, the transportable medium may be a card generated to store a 
randomly generated number or digital information for use in retrieving the ballot for 
the particular voter. 

According to one embodiment, the transportable medium may be a magnetic 

card containing information that may be used at the polling station to provide the 

20 voter with the screen ballot corresponding to that voter. The magnetic card may be 

read at the polling station, and the polling station may then retrieve the correct ballot 

for that particular voter. The information retrieved fi-om the card may be used in 

retrieving the ballot corresponding the particular voter. According to one 

embodiment, the polling station may retrieve the ballot fi-om the polling place server 

25 and present the ballot to the voter. The selected voter information can be compared to 
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stored information of which voters have akeady voted, if it is determined that a voter 
has already voted, no ballot will be generated. 

According to one embodiment, a poll worker may assist an individual who is 
visually impaired with retrieval of the ballot. According to one embodiment the 
5 worker can swipe a magnetic card at the polling station in a magnetic card reader at 
the polling station in order to retrieve the ballot for the visually impaired voter, and 
assist the voter with headphones and location of a user selection means. The display 
of the ballot at the voting station includes providing audio prompts corresponding to 
the matched ballot, the audio prompts are suitable for a visually impaired voter as 
10 described herein allowing the voter to make selections by non-visual means. 

The voter can then respond to audio prompts to make selections, including but 
not limited to selection of language. According to one embodiment, the audio mode 
for the visually impaired may be activated by information generated and stored on the 
transportable medium. 

15 Figure 36 illustrates an embodiment of a Magnetic Card Screen. According to 

one embodiment, a screen is displayed at voter check-in to indicate that a card may be 
swiped at the polling station in a magnetic card reader located at the polling station in 
order to retrieve the ballot information. According to one embodiment a screen is 
displayed at the polling station to indicate that a card may be swiped at the polling 

20 station. 

According to one embodiment, the voting system may access information of 

qualified voters and ballots on a regional level that reaches beyond a particular 

precinct and identifies the ballot appropriate for that voter. This allows for a voter to 

be identified at a precinct's check-in even when outside of their voting district, A 

25 precinct would be able to retrieve the ballot for that particular voter and allow the 
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voter to vote at that location. According to one embodiment, the voting system may 
access qualified voter information for a particular county or for a region extending 
beyond one county. According to one embodiment, the voting system may access 
qualified voter information for an entire state or for a region extending beyond a 
5 single state. According to one embodiment, the qualified voter list may contain voters 
known to be eligible to vote on a country-wide basis. According to one embodiment, 
the regional data extending beyond a single precinct is stored in a qualified voter list. 
According to one embodiment, the regional data extending beyond a single precinct is 
stored in a searchable database. 

10 According to one embodiment, data is stored containing voting data generated 

at a particular voting location. All data and communications can be maintained at a 
single location until voting is complete. Information required to be maintained such 
as which voters voted in a particular election, can be stored. Data reports can be 
automatically generated. Secrecy can be protected by allowing only certain 

1 5 information to be provided in a given report. 

The embodiments of the present invention reduce the time for identifying 
voters at voter check-in. The embodiments of the present invention increase accuracy 
in identifying voters and in providing voters with appropriate ballots. Electronic 
matching of ballots to voters eases the burden on poll workers. This can result in 

20 more voting options being presented to smaller groups of voters, such as proposals 
applying to only a small group of voters without introducing complexity for poll 
workers. Voting records can be generated electronically and stored digitally in real 
time allowing for ease of recreation of data. Voting records can additionally be 
generated in hard copy. Both electronic data and hard copy data can be stored. 
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Many obvious modifications and adaptations of the foregoing embodiments 
will be apparent to those skilled in the art. Any such modifications or adaptations are 
intended to be covered by the appended claims. For example, certain elections may 
not include contests in all the categories of partisan contests, nonpartisan contests, and 
5 proposals, and the voting interface would be programmed to skip the corresponding 
sections of the foregoing method. In addition, the invention could be used with remote 
identification and verification (such as fingerprint ID as described above) to achieve 
Internet voting, for example. 
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